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Background of the Invention 



The invention pertains to control systems and, more particularly, by way of non-limiting 
5 example, to fault-detecting and fault-tolerant methods and apparatus for process control. 

The terms "control" and "control systems" refer to the control of the operational parameters of 
a device or system by monitoring one or more of its characteristics. This is used to insure that output, 
processing, quality and/or efficiency remain within desired parameters over the course of time. 

3 Control is used number of fields. Process control, for example, is typically employed in the 

y 10 manufacturing sector for process, repetitive and discrete manufactures, though, it also has wide 

jf application in electric and other service industries. Environmental control finds application in residential, 

y 

LI commercial, institutional and industrial settings, where temperature and other environmental factors 

must be properly maintained. Control is also used in articles of manufacture, from toasters to aircraft, 
f to monitor and control device operation. 

n 

~ 1 5 Control systems typically utilize field devices that are physically integrated into the equipment 

3 being controlled. For example, temperature sensors are usually installed directly on or within the 

articles, bins, or conduits that process, contain or transport the materials being measured. Control 
devices such as valves, relays, and the like, must also be integrated with the equipment whose 
operations they govern. 



20 Predictability is among the key requirements of any control device. A fluid sensor that even 

occasionally produces flaky readings is unacceptable. Overengineeiing can insure better reliability; 
however, it often results in devices that are too expensive or too large for wide application. 
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Redundancy is a well accepted alternative to overengineeiing. It typically involves using two 
or more standard control elements in place of one. The duplicated units can be field modules, 
controllers or other higher-level elements in the control hierarchy. 



Thus, for example, U.S. Patent 4,347,563 discloses an industrial control system in which 
redundant processing units serve as bus masters "of the moment," monitoring status information 
generated by primary processing units. If a redundant unit detects that a primary has gone faulty while 
executing an applications program, the redundant unit loads that program and takes over the primary's 
5 function. 

U.S. Patent 5,008,805, on the other hand, discloses a real time control system in which 
"sender" and "listener" processors synchronously step through sequential schedules, with the sender 
controlling execution of events sent from a host. The listener monitors the sender and in the event of 
fault, assumes the role of the latter, executing commands omitted during the takeover interval. 

10 A shortcoming of these and many other prior art redundancy schemes is their imposition of 

undue computational or hardware overhead. U.S. Patents 5,008,805, for example, has the 
disadvantage of requiring that the sender and listener operate in lock-step, necessitating common timing 
lines and up-front synchronization procedures. 

An object of this invention is to provide improved methods and apparatus for control and more 
15 particularly, for example, for fault-tolerance and fault-detection in process control. 

A related object of the invention is to provide such methods and apparatus as demand low 
computation and hardware overhead and thus, for example, that can be implemented on a wide range 
of control equipment, from field devices to plant and enterprise servers. 

A further object of the invention is to provide such methods and apparatus as can be 
20 implemented in new control equipment and retrofitted into pre-existing equipment. 



2 



Summary of the Invention 

The foregoing are among the obj ects attained by the invention which provides, in one aspect, 
a method of process, environmental or other control (hereinafter, "control") that includes executing a 
first sequence of instructions in a first process or thread (collectively, "process") and executing a second 
5 sequence of instructions in a second process. The processes are loosely coupled, that is, they do not 
operate in forced lock-step synchronism with one another and need not, for example, share a common 
clock. Though the processes can operate on the same processor, typically, they operate on different 
processors, e.g., within separate elements of a control system. Thus, for example, according to some 
aspects of the invention, the first and second processes are resident and execute on respective partners 
10 in paired field devices (e.g., sensors), block controllers, process controllers, and plant or enterprise 
servers. 

The method further includes comparing states of the first and second processes following their 
respective completions of the first and second instruction sequences. The comparison can cover 
registers, memory, flags, interrupts, tasks, and/or events for each of the respective processes. Thus, 

1 5 for example, to determine whether the two processes executed their respective sequences substantially 
identically ~ and, therefore, are ready to begin to execute additional sequences - one aspect of the 
invention calls for comparing flags set during execution by the interrupt handlers of each process. 
Execution of further instruction sequences by either process is delayed, according to related aspects 
of the invention, pending a favorable comparison of the process states. To this end, one aspect of the 

20 invention calls for comparing the states multiple times, e.g., over a predefined time interval. In addition 
to compensating for non-significant differences in execution speed or event occurrence, employing 
multiple comparisons insures synchronism, fault-detection, and fault-tolerance, while effectuating loose 
coupling of the processes. 

If the processes achieve comparable states following completion of the first and second 
25 sequences, the first process takes up execution of a third sequence, while the second process takes up 
execution of a fourth sequence. In the event that one of the processes does not complete its respective 
instruction sequence, or if the process states do not otherwise favorably compare, an error is signaled. 
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Alternatively, or in addition, the method calls for rolling back the processes to performing error 
diagnostics and/or rolling back the processes to their most recent respective states of agreement, e.g., 
the states prior to execution of the first and second sequences, and retrying execution of those 
sequences. 

5 Further aspects of the invention provide methods as described above in which the instruction 

sequences are selected for execution based on the process states. As above, the state information can 
include registers, interrupts, memory, flags and/or events in each of the respective processes, though 
one aspect of the invention calls for the selection to be made based on the tasks queued for completion 
in each process (e.g., as a result of interrupts received during execution of the prior sequences). 
1 0 Selections made for the respective processes, e.g., the identity of the aforementioned third and fourth 
sequences, can be compared between the processes. As above, the comparison can be conducted 
over a predetermined interval and, in the event of non-agreement, an error can be signaled and/or the 
processes rolled back to a prior state. 

Still further aspects of the invention provide control apparatus operating in accord with the 
1 5 above-described methods. These can comprise devices at any level of the process control hierarchy, 
from process control field device (e.g., sensors) to block controllers to process controllers to plant and 
enterprise servers. 

Still other aspects of the invention provide general purpose digital data processing apparatus 
and methods paralleling the control apparatus and methods described above. 

20 These and other aspects of the invention are evident in the drawings and in the description that 

follows. 

Systems according to the invention have a number of advantages over the prior art. Among 
these are that they permit control devices to provide fault-detection and achieve fault tolerance without 
special-purpose hardware. Instead, only a minimal facility to exchange state information between the 
25 modules is necessary. The invention, as evident below, can be used with either hardware-based error 
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detection or software comparison or arbitration. The invention can also be embodied in dual-partnered 
systems, as well as those that are triply or quadruply redundant. 
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Brief Description of the Drawings 

A more complete understanding of the invention may be attained by reference to the drawings, 
in which: 

Figure 1 depicts a pair of process control field devices according to the invention; 
5 Figure 2 depicts a method of operation of a synchronizing-scheduler in the devices of Figure 

l; 

Figures 3 A and 3B depict a method of operation of a synchronizer in the devices of Figure 1 ; 

and 

Figure 4 depicts a process control system with field devices, control processors and plant or 
10 enterprise servers according to the invention. 
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Detailed Description of the Illustrated Embodiment 

Figure 1 depicts a pair of process control devices 10, 12 according to the invention. The 
illustrated devices are field devices, though the invention may applied to other control devices as well, 
such as, by non-limiting example, block controllers, process controllers, plant and enterprise servers, 
5 and environmental and industrial controls and controllers. 

Illustrated devices 10, 12 include processing sections 18, 20 and sensing apparatus ~ in this 
case, by way of non-limiting example, sensors 14, 16 for measuring flow along pipe 17. The sections 
1 8, 20 are constructed and operated in accord with the teachings herein to provide fault detection and 
fault tolerance. They can also be configured to provide signal conditioning and other functions 

1 0 commonly known in the art. To these ends, illustrated sections 1 8, 20 can comprise general or special 
purpose digital data processing apparatus, including central processing units 22, 24 and various storage 
devices, such as code stores 26, 28 and event stores 30, 32. These storage devices may be embodied 
in any conventional storage units, such as, by way of nonJimiting example, EEPROMS or DRAMS, 
and they may be implemented in any conventional manner, e.g., arrays, linked lists, b-trees, and so 

1 5 forth. In addition to, or in lieu of such digital data processing apparatus, illustrated sections 1 8, 20 may 
comprise analog electronics or other functionality configured for carrying out the tasks described herein. 

Control devices 10, 12 are coupled to one another for the exchange of state information of the 
type described below. In the illustrated embodiment, such exchange takes place over communication 
pathway 38, which may be connected to the serial, parallel, or other input/output ports of the respective 
20 processing sections. Pathway 38 can be implemented via cable, bus, LAN, WAN, Internet, or other 
direct, indirect or networked medium. Moreover, it may be implemented via conventional cabling or 
via infrared, microwave or transmission-based medium. 

In addition to being coupled to one another, sections 1 8, 20 can be coupled to other elements 
of a process control system, such as, block controllers, process controllers, and plant and enterprise 
25 servers. In the illustrated embodiment, such coupling is provided via network 40 (e.g., an Ethernet 
network). As above, this may be implemented via cable, bus, LAN, WAN, Internet, or other direct, 
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indirect or networked medium, using conventional cabling, infrared, microwave or transmission-based 
medium. Those skilled in the art will, of course, appreciate that the information exchange described 
below as taking place over line 38 can, instead or in addition, take place over network 40. 

Illustrated stores 30, 32 contain information reflecting a state of each respective process control 
device 10, 12. In the illustrated embodiment, these comprise event flags generated by interrupt 
handlers (not shown) executing on the respective central processing units 22, 24. The flags represent 
external interrupts, such as those received from sensors 14, 16, from other process control devices 
coupled to network 40, and from other peripheral attached directly to devices 10, 12. The flags also 
represent internal interrupts, such as those generated by watch-dog and other timers (not shown) 
internal to the processing sections 18, 20. 

The state of control devices 10, 12 may be reflected by other information, as well. This can 
include, for example, pending interrupts, task and event queues, and so forth. As discussed below, 
state information used in the illustrated embodiment also includes the identity portions of code 
sequences, i.e., subsequences or slices, elected for execution by each device 10, 12, which information 
may be maintained, for example, in registers or other memory areas in the devices. 

Code stores 26, 28 contain computer instructions ("code") for execution by processing sections 
18, 20, e.g., in response to events listed in event stores 30, 32. The code, which may of the type 
generally known in the art of process control or which may be otherwise suitable therefore (whether 
or not currently known), is preferably parceled into units or "slices" 42 - 52. These slices may be, for 
example, indivisible or "atomic" sequences of code. They may also be divisible sequences sized for 
efficient execution in view of the synchronization methodologies described herein. As discussed below, 
a preferred slice represents an increment of work that is small enough to be completed in a time interval 
consistent with the delay that can be accepted if the thread executing it is preempted. 

Illustrated central processing units 22, 24 are of the conventional type known in the art capable 
of executing instruction sequences within processes, threads and other such instruction execution 
contexts (collectively, "processes"). In addition to slices 42 - 52 contained in code stores 26, 28, the 



CPUs 22, 24 execute code for purposes of identifying events and scheduling slices (i.e., synchronizing- 
schedulers 54, 60), synchronizing event identification and slice selection (i.e., synchronizers 56 62), and 
dispatching slices for execution (i.e., dispatchers 58, 64). 

In the illustrated embodiment, code executed by the CPUs 22, 24 and, particularly, code 
5 executed from stores 26, 28, is broken up into execution slices 42 - 52. An execution slice is an 
increment of work that is small enough to be completed in a time interval consistent with the delay that 
can be accepted if the process or thread executing it is preempted. In addition, each slice starts at the 
logical beginning of an operation, and ends when the operation is completed. At slice completion, the 
execution is between contexts. 



1 0 While this approach can be applied to general purpose software, it is particularly suited to 

applications that have an appropriately "sliceable" structure. Process control software has this 
characteristic. Exploiting it accomplishes two things. The first is to reduce the "operating system" to a 
simple synchronizing-scheduler. The second is that the synchronizing-scheduler 54, 60 simplifies 
attaining fault tolerance. It is this simplification, among other things, which makes it possible to support 

1 5 fault tolerant operation with the available hardware resources. 



Each synchronizing-scheduler 54, 60 recognizes and synchronizes all pending events. As 
discussed above, events typically result from interrupts, e.g., clock interrupts, communication interrupts, 
etc., that have occured during execution of a prior slice. Some events, indeed, are a natural result of 
slice execution itself, e.g., events reflecting the availability of data computed by the prior slice. After 
20 each synchronizing-scheduler 54, 60 synchronizer its pending events with the other synchronizing- 
scheduler (or, other synchronizing-schedulers), it selects a next slice for execution, and synchronizes 
that selection. In some embodiments, the identities of the slices selected for execution are not 
synchronized; rather, merely, the fact that slices have been selected for execution. 



Operation of the illustrated synchronizing-schedulers 54, 60 is shown in Figure 2 and described 
25 in the pseudo-code fragment that follows: 
while true (step 70) 
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if rollback_cnt > max_rollbacks break; (step 72) 
if more unsynchronized events then (step 74) 

select highest priority pending event (step 76) 

invoke synchronizer to confirm that partner selected same event (step 78) 
5 if synchronization was successful (step 80) 

rollback_cnt = 0 (step 79) 

else 

increment rollback_cnt (step 81) 

endif 

10 continue 
endif 

select code slice for execution to process event (step 82) 
invoke synchronizer to confirm that partner selected same slice (step 84) 
if synchronization not successful (step 86) 
1 5 increment rollback_cnt (step 81) 

continue 

endif 

rollback_cnt = 0 (step 87) 
dispatch to execute selected slice (step 88) 
20 end while 

signal error (step 91) 

perform error handling (step 92) 

The type and degree of error handling in step 92 depends on the nature of the application. In 
some embodiments, no error handling at all is performed after the fault is signalled. In other 
25 embodiments, the processes are rolled back to state of last agreement. In still other embodiments, a 
fault diagnostic procedure is performed to isolate the source of error. 

As noted above, devices 10, 12 on both sides of the redundant pair have synchronization, or 
sync, lines 38 running between them that are used to keep their operation synchronized. This enforces 
loose coupling between the devices 10, 12 and, more particularly, between their respective processing 
30 sections 18, 20. One of the devices 10 is configured to be the master, and the other 12, the shadow. 
The synchronizer operation for the master 10 is shown in Figure 3 A and described in the pseudo-code 
that follows: 

write event/slice code on sync out lines (step 102) 
set timeout register 
35 initialize sync results to false 

10 



do 

decrement timeout register 
read input from partner (step 104) 
while shadow agrees = false and timeout != 0 (step 106) 

5 if timeout register != 0 (step 108) 

write "null" code on sync out lines (step 1 10) 
do 

decrement timeout register 
read input from partner (step 112) 
10 while shadow agrees = true and timeout != 0 (step 1 14) 

endif 

if timeout register != 0 (step 116) 

sync results = true (success) (step 118) 

endif 

1 5 return sync results 

The shadow 1 2 executes a similar synchronization routine, which is described below and shown in 
Figure 3B. 

set timeout register initialize sync result 
to false 
20 do 

decrement timeout register 
read master synch state 
while shadow state != master state and timeout != 0 
operation code and timeout register != 0 
25 if timeout register != 0 

write "shadow agrees" on synch line 
do 

decrement timeout register 
read input from partner 
30 while master state != "null" and timeout != 0 

endif 

if timeout register != 0 

synch results = success 

endif 

35 return synch results 

As noted above, the invention can be applied to process control apparatus other than field 
devices 10, 12, as well. A process control system in which the invention is employed in a plurality 
of pairs of process control devices 120, block controllers 122 and plant servers 124 is illustrated in 
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Figure 4. Although the processing performed by these various apparatus differs in accord with their 
levels in the system, their processing sections perform scheduling and synchronization in the manner 
describeds above in order to provide fault-detection and tolerance. 

In one embodiment, the invention is employed in coprocessors that serve as communication 
5 controllers for a network of field modules. Such coprocessor can be contained, for example, within 
one or more of the block controllers 122 of the type shown in Figure 4. Software executing on the 
CPUs of those coprocessors is both multithreaded and fault tolerant. It constitutes a complete 
stand-alone executable that sits directly on top of the hardware, preferably, without the need for a 
separate operating system. 

10 The aformentioned embodiment is multithreaded with priority scheduling. It does this 

without a general purpose context-preserving task switch mechanism. Instead the work is broken 
up into execution slices as described above. The basis of the slices chosen for the coprocessors is 
to associate a slice with the work required to send or receive a particular message over network 
40. There are two reasons for this. First, the hardware events associated with the network activity 

15 are good synchronization markers. Second, when one considers fault tolerant error recovery 
scenarios, the last completed network message is a good point to restart from. 

Within the aforementioned coprocessors, each channel is an independent stream of 
communications transactions associated with a set of data structures in memory that they share 
between them. A channel is also an execution thread. Each channel has a unique priority. On the 
20 "host" side of the shared memory interface, each channel is associated with a vrtx task of 
corresponding priority. 

The communications channels are identical except for priority and assigned buffer sizes. The 
number of channels is controlled by the initialization of master control structures contained in the 
shared memory. They share a single common set of routines that execute three basic types of slices: 

25 1 . routines that convert a list of transaction requests into the corresponding request messages; 
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2. 



routines that send the messages and wait for the replies; 



3. routines that convert the messages into the required lists of responses 

The execution state of each channel is recorded in a channel data structure within the shared 
memory. Once started, execution of the slice continues until it completes. The stored state 
5 information identifies the next slice to be executed, if any, for each channel. 

Fault tolerance error scenarios include exception cases where a slice in progress cannot be 
completed. In these cases, it is simply abandoned. Because the channel data that controls 
scheduling is not updated until the slice completes, the slice will be restarted from its beginning 
when/if the execution thread is resumed. 

10 At a logical and priority level above the communications channels, the master control 

structures provide what can be thought of as a master control channel. Associated actions at this 
level always complete. They are independent slices. They range from bus switching to mechanisms 
for fault tolerance exception handling. Each synchronizing-scheduler within the coprocessors 
checks the master control structure, then the channel information in priority order, to identify the 

15 highest priority slice available for execution. Interrupts are serviced during slice execution, but any 
resulting thread switch occurs after the current slice is completed. 

After a synchronizing-scheduler selects the next slice, it invokes its respective synchronizer. 
During married fault tolerant operation, the synchronizers in the master and shadow use hardware 
handshake lines and logic as described to ensure that the both sides choose the same next slice. If 
20 this process fails, the synchronizers proceed as described above. 
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In this coprocessor embodiment, the sync lines transmit data with the following values and 



meanings: 



0. 
1. 
2. 
3. 
4. 
5. 
6. 
7. 



NULL (no sync state being declared) 



Entering sched 
Host interrupt 
Transmit sync 
Receive event 
Time event 



Interrupt to Host 
Error case 



Continuing discussion of the aforementioned embodiment, the synchronizer must be able to 
unambiguously establish success or failure and it must always return the same value on both sides. 
To this end, the hardware handshake in the coprocessor uses three parallel lines from master to 
shadow and 1 from shadow to master. The logic above has a timing window. If the shadow sets 

15 the ''shadows agress" true just as the master times out, the master will return failure and the shadow 
will return success. The master mus to continue to assert the synch code for a brief intercval after it 
sees the shadow agrees signal. The shadow then checks that the masters synch code is set to null 
slightly after the agree line goes true. Those skilled in the art will, of course, appreciate that 
operation of any given synchronizer will depend strongly on the number of different states that 

20 require recognition and the hardware resources available to support it. 

Described herein are methods and apparatus meeting the desired objects. Those skilled in 
the art will appreciate that the specific embodiments shown in the drawings and described above 
are examples of the invention and that other embodiments incorporating changes therein also fall 
within the scope of the invention. Thus, for example, it will be appreciated that the invention can be 
25 applied to process, industrial, environmental and other control systems and devices utilizing triple 
modular redundancy, quaduple modular redundancy and still higher levels of redundancy, as well as 
to those utilizing paired units (or double modular redundancy) as shown in the examples herein. By 
way of further example, it will be appreciated that the partnered processes can exchange and 
compare state information different than that described here. By way of still further example, it will 
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be appreciated that the invention can be applied to digital data processing apparatus and systems, 
as well. 

In view of the foregoing what we claim is: 
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1. A method of operation of a control system, comprising 

A. executing a first sequence of instructions in any of a first process and first thread 
(collectively, "first process"), 

B. executing a second sequence of instructions in any of a second process and second thread 
(collectively, "second process"), the second process being loosely coupled with respect to 
the first process, 

C. comparing a state of the first process following completion by it of execution of the first 
instruction sequence with a state of the second process following completion by it of the 
second instruction sequence, and 

D. Wherein each of the first and second processes execute on any of a process control field 
device, a block controller, a process controller, a process control plant server, a process 
control enterprise server, an industrial control device, an industrial control system, an 
environmental control device, an environmental control system, other control device, and 
other control system. 

2. A method according to claim 1, comprising the step of executing step (C) one or more 
times over a time interval in order to determine whether the first and second processes 
achieve comparable states following completion of execution of the first instruction 
sequence by the first process. 

3. A method according to claim 2, comprising the step responding to a favorable comparison 
in step (C) by repeating steps (A) - (C) with a third instruction sequence in place of the first 
instruction sequence, and with a fourth instruction sequence in place of the second 
instruction sequence. 
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4. A method according to claim 3, comprising the steps of 

selecting the third instruction sequence as a function of a state of the first process following 
execution of the first instruction sequence, and 

selecting the fourth instruction sequence as a function of a state of the second process 
following execution of the second instruction sequence. 

5. A method according to claim 4, comprising comparing a state of the first process prior to 
execution by it of the third instruction sequence with a state of the second process prior to 
execution by it of the fourth instruction sequence. 

6. A method according to any of claims 1, 3 and 5, comprising the step of signaling an error in 
response to a failure of the first and second processes to achieve comparable states at a 
time of comparison. 

7. A method according to claim 6, comprising the step of rolling back each of the first and 
second processes to a prior states in which a favorable comparison was achieved. 

8. A method according to claim 1 , wherein step (C) comprises comparing any of registers, 
memory, flags, interrupts, tasks, and events in the respective processes. 

9. A method according to claim 1, wherein each of the first and second processes comprise 
any of a thread and a process, and wherein the first and second processes execute on any 
of the same and different digital data processing apparatus. 
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A control apparatus, comprising 

any of a first process and first thread (collectively, "first process") executing a first sequence 
of instructions, 

any of a second process and second thread (collectively, "second process") executing a 
second sequence of instructions, 

comparison logic in communication with the first and second processes, the comparison 
logic comparing a state of the first process to a state of the second process following 
execution by them of the respective first and second sequences of instructions. 

Wherein each of the first and second processes execute on any of a process control field 
device, a block controller, a process controller, a process control plant server, and a 
process control enterprise server, industrial control device, an industrial control system, an 
environmental control device, an environmental control system, other control device, and 
other control system. 

An apparatus according to claim 10, wherein the comparison logic compares any of 
registers, memory, flags, interrupts, tasks, and events in each of the respective processes. 

An apparatus according to claim 11, wherein the comparison logic comprises 

a first comparison logic section operating in the first process for comparing a state of the 
first process following completion by it of execution of the first instruction sequence with a 
state of the second process following completion by it of the second instruction sequence, 
and 

a second comparison logic section operating in the second process for comparing a state of 
the second process following completion by it of execution of the second instruction 
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sequence with a state of the first process following completion, if any, by it of the first 
instruction sequence. 



13. An apparatus according to claim 12, including scheduling logic in communication with the 
first and second processes and in communication with the comparison logic, 



the scheduling logic scheduling the first process to execute a third sequence of instructions in 
response to a favorable comparison by the comparison logic, 



the scheduling logic scheduling the second process to execute a fourth sequence of 
instructions in response to a favorable comparison by the comparison logic. 



14. An apparatus according to claim 13, wherein the comparison logic compares a state of the 
first process prior to execution by it of the third instruction sequence with a state of the 
second process prior to execution by it of the fourth instruction sequence. 



15. An apparatus according to claim 10, wherein the comparison logic signals an error in 
response to a failure of the first and second processes to achieve comparable states at a 
time of comparison. 



16. An apparatus according to claim 15, wherein the scheduling logic responds to an error by 
rolling back each of the first and second processes to a prior states in which a favorable 
comparison was achieved. 



17. An apparatus according to any of claims 10, 13 and 14, wherein the comparison logic 

compares a state of the first process with a state of the second process a plurality of times 
to determine whether the first and second processes to achieve comparable states. 
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An apparatus according to claim 10, wherein each of the first and second processes 
comprise any of a thread and a process, and wherein the first and second processes 
execute on any of the same and different digital data processing apparatus. 

A process control apparatus, comprising 

any of a first process and a first task (collectively, "first process"), 

any of a second process and a second task (collectively, "second process"), 

scheduling logic in communication with the first and second processes, the scheduling logic 
scheduling the first process to execute a first subsequence of instructions from a first 
sequence of instructions, the scheduling logic scheduling the second process to execute a 
first subsequence of instructions from a second sequence of instructions, 

comparison logic in communication with the first and second processes, the comparison 
logic comparing a state of the first process following completion by it of execution of the 
first instruction subsequence of instructions with a state of the second process following 
completion, if any, by it of the second subsequence of instruction, wherein states of the first 
and second processes include any of registers, memory, flags, interrupts, tasks, and events 
in those respective processes, 

synchronization logic in communication with the comparison logic, the synchronization logic 
responding to a favorable comparison by the comparison logic by scheduling the first 
process to execute a second subsequence of instructions from the first sequence of 
instructions and scheduling the second process to execute a second subsequence of 
instructions from the second sequence of instructions, 



20 



20. An apparatus according to claim 19, wherein the scheduling logic comprises 

a first scheduling logic section operating in the first process, the first scheduling logic section 
scheduling the first process to execute a first subsequence of instructions from a first 
sequence of instructions, and the first scheduling logic section responding to a favorable 
comparison by the comparison logic by scheduling the first process to execute a second 
subsequence of instructions from the first sequence of instructions, and 

a second scheduling logic section operating in the second process, the second scheduling 
logic section scheduling the second process to execute a second subsequence of 
instructions from a first sequence of instructions, and the second scheduling logic section 
responding to a favorable comparison by the comparison logic by scheduling the second 
process to execute a second subsequence of instructions from the second sequence of 
instructions. 

21. An apparatus according to claim 20, wherein the synchronization logic comprises 

a first comparison logic section operating in the first process, the first comparison logic 
section comparing a state of the first process following completion by it of execution of the 
first instruction sequence with a state of the second process following completion, if any, by 
it of the second instruction sequence, and 

a second comparison logic section operating in the second process, the second comparison 
logic section comparing a state of the second process following completion by it of 
execution of the second instruction sequence with a state of the first process following 
completion, if any, by it of the first instruction sequence. 

22. An apparatus according to claim 21, wherein at least one of the first and second 
comparison logic sections signals an error in response to a failure of the first and second 
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processes to achieve comparable states following completion of execution of the respective 
subsequence of instructions by the respective process. 



23. An apparatus according to claim 22, wherein the comparison logic compares a state of the 
first process with a state of the second process a plurality of times to determine whether the 
first and second processes to achieve comparable states. 



24. An apparatus according to claim 22, wherein the scheduling logic responds to an error by 
rolling back each of the first and second processes to a prior states in which a favorable 
comparison was achieved. 



25. An apparatus according to claim 19, wherein each of the first and second processes 
comprise any of a thread and a process, and wherein the first and second processes 
execute on any of the same and different digital data processing apparatus. 



26. An apparatus according to claim 19, comprising wherein each of the first and second 
processes execute on any of a process control field device, a block controller, a process 
controller, a process control plant server, and a process control enterprise server. 



A. any of a first process and a first task (collectively, "first process") executing a first sequence 
of instructions, 

B. any of a second process and a second task (collectively, "second process") executing a 
second sequence of instructions, 

C. synchronization logic in communication with the first and second processes, the 
synchronization logic preventing the first process from executing a third sequence of 




21 V A process control apparatus, comprising 
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instructions until the first and second processes have completed execution of the first and 
second sequences of instructions, respectively. 

28. An apparatus according to claim 27, wherein the synchronization logic prevents the second 
process from executing a fourth sequence of instructions until the first and second processes 
have completed execution of the first and second sequences of instructions, respectively. 

29. An apparatus according to any of claims 27 and 28, wherein the comparison logic 
compares a state of the first process with a state of the second process a plurality of times 
to determine whether the first and second processes to achieve comparable states. 

30. An apparatus according to claim 27, wherein the synchronization logic comprises 

a first comparison logic section operating in the first process, the first comparison logic 
section comparing a state of the first process following completion by it of execution of the 
first instruction sequence with a state of the second process following completion, if any, by 
it of the second instruction sequence, 

a second comparison logic section operating in the second process, the second comparison 
logic section comparing a state of the second process following completion by it of 
execution of the second instruction sequence with a state of the first process following 
completion, if any, by it of the first instruction sequence, 

wherein states of the first and second processes include any of registers, memory, flags, 
interrupts, tasks, and events in those respective processes. 

31. An apparatus according to claim 30, wherein at least one of the first and second 
comparison logic sections signals an error in response to a failure of the first and second 
processes to achieve comparable states following completion of execution of the respective 
subsequence of instructions by the respective process. 
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An apparatus according to claim 31, wherein the scheduling logic responds to an error by 
rolling back each of the first and second processes to a prior states in which a favorable 
comparison was achieved. 

An apparatus according to claim 27, wherein each of the first and second processes 
comprise any of a thread and a process, and wherein the first and second processes 
execute on any of the same and different digital data processing apparatus. 

An apparatus according to claim 27, comprising wherein each of the first and second 
processes execute on any of a process control field device, a block controller, a process 
controller, a process control plant server, and a process control enterprise server. 

A method of process control, comprising 

executing a first sequence of instructions in any of a first process and a first task 
(collectively, "first process"), 

executing a second sequence of instructions in any of a second process and a second task 
(collectively, "second process"), the second process being loosely coupled with respect to 
the first process, 

comparing, within the first process, a state of the first process following completion by it of 
execution of the first instruction sequence with a state of the second process following 
completion, if any, by it of the second instruction sequence, 

comparing, within the second process, a state of the second process following completion 
by it of execution of the second instruction sequence with a state of the first process 
following completion, if any, by it of the first instruction sequence. 

A method according to claim 35, including the steps of 
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scheduling the first process to execute a third sequence of instructions in response to a 
favorable comparison in step (C), and 

scheduling the second process to execute a fourth sequence of instructions in response to a 
favorable comparison in step (D). 

A method according to claim 35, wherein any of steps (C) and (D) include the step of 
signaling an error in response to a failure of the first and second processes to achieve 
comparable states following completion of execution of the respective instruction sequence 
by the respective process. 

A method according to claim 37, wherein any of steps (C) and (D) include comparing a 
state of the respective process with a state of the other process a plurality of times to 
determine whether they achieve comparable states. 

A method according to claim 35, wherein each of the first and second processes comprise 
any of a thread and a process, and wherein the first and second processes execute on any 
of the same and different digital data processing apparatus. 

A method according to claim 35, comprising wherein each of the first and second processes 
execute on any of a process control field device, a block controller, a process controller, a 
process control plant server, and a process control enterprise server. 

A method for process control, comprising 

executing a first subsequence of instructions from a first sequence of instructions in any of a 
first process and a first task (collectively, "first process"), 

executing a first subsequence of instructions from a second sequence of instructions in any 
of a second process and a second task (collectively, "second process"), 
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C. comparing a state of the first process following completion by it of execution of the first 
subsequence of instructions from the first sequence of instructions with a state of the second 
process following completion, if any, by it of the first subsequence of instructions from the 
second sequence of instructions, 

D. responding to a favorable comparison in step (C) by scheduling the first process to execute 
a second subsequence of instructions from the first sequence of instructions and scheduling 
the second process to execute a second subsequence of instructions from the second 
sequence of instructions. 

42. A method according to claim 41, wherein step (C) includes 

comparing, from within the first process, a state of the first process following completion by 
it of execution of the first instruction sequence with a state of the second process following 
completion, if any, by it of the second instruction sequence, and 

comparing, from within the second process, a state of the second process following 
completion by it of execution of the second instruction sequence with a state of the first 
process following completion, if any, by it of the first instruction sequence. 

43. A method according to claim 42, wherein step (C) includes responding to a failure of the 
first and second processes to achieve comparable states following completion of execution 
of the respective subsequence of instructions by the respective process. 

44. A method according to claim 43, wherein step (C) includes comparing a state of the first 
process with a state of the second process a plurality of times to determine whether the first 
and second processes to achieve comparable states. 
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45. A method according to claim 41 , wherein each of the first and second processes comprise 
any of a thread and a process, and wherein the first and second processes execute on any 
of the same and different digital data processing apparatus. 



46. A method according to claim 41, comprising wherein each of the first and second processes 
execute on any of a process control field device, a block controller, a process controller, a 
process control plant server, and a process control enterprise server. 



A. executing a first sequence of instructions in any of a first process and first thread 
(collectively, "first process"), 

B. executing a second sequence of instructions in any of a second process and second thread 
(collectively, "second process"), the second process being loosely coupled with respect to 
the first process, 

C. comparing a state of the first process following completion by it of execution of the first 
instruction sequence with a state of the second process following completion by it of the 
second instruction sequence. 

48. A method according to claim 47, comprising the step of executing step (C) one or more 
times over a time interval in order to determine whether the first and second processes 
achieve comparable states following completion of execution of the first instruction 
sequence by the first process. 

49. A method according to claim 48, comprising the step responding to a favorable comparison 
in step (C) by repeating steps (A) - (C) with a third instruction sequence in place of the first 
instruction sequence, and with a fourth instruction sequence in place of the second 
instruction sequence. 




A method of operation of a digital data processing system, comprising 
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50. A method according to claim 49, comprising the steps of 

selecting the third instruction sequence as a function of a state of the first process following 
execution of the first instruction sequence, and 

selecting the fourth instruction sequence as a function of a state of the second process 
following execution of the second instruction sequence. 

51. A method according to claim 50, comprising comparing a state of the first process prior to 
execution by it of the third instruction sequence with a state of the second process prior to 
execution by it of the fourth instruction sequence. 

52. A method according to any of claims 47, 49 and 51, comprising the step of signaling an 
error in response to a failure of the first and second processes to achieve comparable states 
at a time of comparison. 

53. A method according to claim 52, comprising the step of rolling back each of the first and 
second processes to a prior states in which a favorable comparison was achieved. 

54. A method according to claim 47, wherein step (C) comprises comparing any of registers, 
memory, flags, interrupts, tasks, and events in the respective processes. 

55. A method according to claim 47, wherein each of the first and second processes comprise 
any of a thread and a process, and wherein the first and second processes execute on any 
of the same and different digital data processing apparatus. 

56. A method according to claim 47, comprising wherein each of the first and second processes 
execute on any of a process control field device, a block controller, a process controller, a 
process control plant server, and a process control enterprise server. 
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A digital data processing apparatus, comprising 

any of a first process and first thread (collectively, "first process") executing a first sequence 
of instructions, 

any of a second process and second thread (collectively, "second process") executing a 
second sequence of instructions, 

comparison logic in communication with the first and second processes, the comparison 
logic comparing a state of the first process to a state of the second process following 
execution by them of the respective first and second sequences of instructions. 

An apparatus according to claim 57, wherein the comparison logic compares any of 
registers, memory, flags, interrupts, tasks, and events in each of the respective processes. 

An apparatus according to claim 58, wherein the comparison logic comprises 

a first comparison logic section operating in the first process for comparing a state of the 
first process following completion by it of execution of the first instruction sequence with a 
state of the second process following completion by it of the second instruction sequence, 
and 

a second comparison logic section operating in the second process for comparing a state of 
the second process following completion by it of execution of the second instruction 
sequence with a state of the first process following completion, if any, by it of the first 
instruction sequence. 

An apparatus according to claim 59, including scheduling logic in communication with the 
first and second processes and in communication with the comparison logic, 
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the scheduling logic scheduling the first process to execute a third sequence of instructions in 
response to a favorable comparison by the comparison logic, 



the scheduling logic scheduling the second process to execute a fourth sequence of 
instructions in response to a favorable comparison by the comparison logic. 



61 . An apparatus according to claim 60, wherein the comparison logic compares a state of the 
first process prior to execution by it of the third instruction sequence with a state of the 
second process prior to execution by it of the fourth instruction sequence. 



62. An apparatus according to claim 57, wherein the comparison logic signals an error in 
response to a failure of the first and second processes to achieve comparable states at a 
time of comparison. 



63. An apparatus according to claim 62, wherein the scheduling logic responds to an error by 
rolling back each of the first and second processes to a prior states in which a favorable 
comparison was achieved. 



64. An apparatus according to any of claims 57, 60 and 63, wherein the comparison logic 

compares a state of the first process with a state of the second process a plurality of times 
to determine whether the first and second processes to achieve comparable states. 



65. An apparatus according to claim 57, wherein each of the first and second processes 
comprise any of a thread and a process, and wherein the first and second processes 
execute on any of the same and different digital data processing apparatus. 



66. An apparatus according to claim 57, comprising wherein each of the first and second 
processes execute on any of a process control field device, a block controller, a process 
controller, a process control plant server, and a process control enterprise server. 
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Abstract 



A method of process, industrial, environmental or other control includes executing a first 
sequence of instructions in a first process (or thread) and executing a second sequence of 
instructions in a second process (or thread) that is loosely coupled with the first. States of the first 
and second processes are compared following their respective completions of the first and second 
instruction sequences. The comparison can cover registers, memory, flags, interrupts, tasks, and/or 
events in each of the respective processes. Execution of further instruction sequences by either 
process is delayed pending a favorable comparison of the process states. If the process achieve 
comparable states, the first process can take up execution of a third sequence, while the second 
process takes up execution of a fourth sequence. In the event that one of the processes does not 
complete its respective instruction sequence within a set period of time, or if the process states do 
not otherwise favorably compare after execution of the respective sequences, the method calls for 
signaling an error. A device for process, industrial, environmental or other control operates in 
accord with such a method. 

Exchange.1477747.2 
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